Feedback Detection for Live Predictors
نویسندگان
چکیده
A predictor that is deployed in a live production system may perturb the features it uses to make predictions. Such a feedback loop can occur, for example, when a model that predicts a certain type of behavior ends up causing the behavior it predicts, thus creating a self-fulfilling prophecy. In this paper we analyze predictor feedback detection as a causal inference problem, and introduce a local randomization scheme that can be used to detect non-linear feedback in real-world problems. We conduct a pilot study for our proposed methodology using a predictive system currently deployed as a part of a search engine.
منابع مشابه
Formative Assessment and Feedback as Predictors of Students’ Engagement
To explore the effects of formative assessment on student engagement in classroom, 60 upper-intermediate level EFL students, were chosen out of a convenience sample of 120, using the Oxford Placement Test and were randomly assigned to experimental and control groups. After the intervention, the students were asked to complete the Student Course Engagement Questionnaire. Independent sample t-tes...
متن کاملExpert Coaching in Weight Loss: Retrospective Analysis
BACKGROUND Providing coaches as part of a weight management program is a common practice to increase participant engagement and weight loss success. Understanding coach and participant interactions and how these interactions impact weight loss success needs to be further explored for coaching best practices. OBJECTIVE The purpose of this study was to analyze the coach and participant interact...
متن کاملDetermination of RT-PCR detection limit of live and dead Salmonella cells in raw and sterilized milk
The objective of the current study was to evaluate the reproducibility of a reverse transcriptase PCR (RT-PCR)-based technique to differentiate viable and dead Salmonella cells in raw and sterilized milk. The microorganism was initially inoculated into the milk samples followed by incubating at 37°C for 4 h prior to inactivation by heat at 80°C for 10 min. The treated and non-treated samples we...
متن کاملEffect Feedback after Good and Poor Trials on learning and Error Detection Ability Children in Dart Throwing Skill
Augmented feedback is information that guidance performance to direction correct response and has critical role in motor skill learning. The purpose of this study was to examine the effect of knowledge of results, after good and poor trials on learning and error estimation capability in children.32 elementary students (Mean age 10/4, SD ± 0/9) that all novice and no experience in dart skill par...
متن کاملRobust Fault Detection on Boiler-turbine Unit Actuators Using Dynamic Neural Networks
Due to the important role of the boiler-turbine units in industries and electricity generation, it is important to diagnose different types of faults in different parts of boiler-turbine system. Different parts of a boiler-turbine system like the sensor or actuator or plant can be affected by various types of faults. In this paper, the effects of the occurrence of faults on the actuators are in...
متن کامل